| Author |
Thread Statistics | Show CCP posts - 9 post(s) |

Zepheros Naeonis
TinklePee
73
|
Posted - 2016.03.10 14:48:12 -
[1] - Quote
Kata Amentis wrote:It's quite interesting, but some of the "correct" results don't make sense from either a description or sample image stand point. For example Bafflededit: More BaffledCould someone explain how that is the right answer? asymmetrical bloby/tubular compared to the "correct" symmetrical vainy/web.     Is that "correct" in the sense that an above average number of people on sisi clicked on it, so we're being penalised because people are just clicking through carelessly? a bug? naff data in the project? etc.  edit: couple of samples later, I get something almost the same as before "ok, it was this last time..." wrong.... erm   I am getting this more times than I can count and it is beginning to **** me off. I'm going to take the suggestion someone else mentioned and close/reopen after every submission to see if that helps. |

Zepheros Naeonis
TinklePee
74
|
Posted - 2016.03.11 11:22:35 -
[2] - Quote
HPA Darkfield Oramara wrote:Zepheros Naeonis wrote:Kata Amentis wrote:It's quite interesting, but some of the "correct" results don't make sense from either a description or sample image stand point. For example Bafflededit: More BaffledCould someone explain how that is the right answer? asymmetrical bloby/tubular compared to the "correct" symmetrical vainy/web.     Is that "correct" in the sense that an above average number of people on sisi clicked on it, so we're being penalised because people are just clicking through carelessly? a bug? naff data in the project? etc.  edit: couple of samples later, I get something almost the same as before "ok, it was this last time..." wrong.... erm   I am getting this more times than I can count and it is beginning to **** me off. I'm going to take the suggestion someone else mentioned and close/reopen after every submission to see if that helps. EDIT: http://i.imgtc.com/LDtorSg8cF.png
Don't mind my answer, I should have just skipped it honestly. 100% selected Cytoplasm when it clearly states that it is "seen throughout the entire cell EXCEPT FOR THE NUCLEUS (blue part)". The Nucleus is completely riddled with the cytoplasm, so how is Cytoplasm even an option in this case? I am either completely lost in my understanding of how picking between the groups works or this is just a spam fest of amazing proportions. http://i.imgtc.com/8NYTqicNoS.png
HOLY FACEPALM Community consensus needs to be scrubbed asap. I'm sorry to say, but there should be someone at least reviewing a sample after a certain number of submissions to determine whether they are on the right track or not. They are going to receive so many flawed results it isn't even funny. As one of the researchers for this project I would say that your first image looks like a plasma membrane staining, together with nucleoli (and maybe also an additional cytoplasmic and nuclear staining, hard to tell when not being able to toggle the different channels). The point is however that there's very common that the protein is located to two organelles or more, which means that a cell with both cytoplasmic and nuclear staining will have staining in both the area overlapping with the red and the blue marker. The descriptions of the different locations are only true if there would be a cytoplasmic staining only. This is a bit tricky of course, but usually the different stainings don't have the exact same intensity which might make it possible to differentiate them. I agree that the second image would rather be labeled as vesicles, but I can't really tell what the consensus for that location is from the image. And what we have seen from the result from the test server is that you guys actually are doing really good! This clarification regarding Cytoplasm and nuclear staining helps out a lot, thank you.
Also, the consensus was mostly visible, but the main reason I pointed it out was the 60% selection for Cytoplasm when it is clearly Vesticles, if anything. (Which was my choice). I don't recall now if that was the remainding 20% for Cytoplasmic categories.
Thank you for the response. I find it unusual that the test server turned out so positive when it seems completely opposite on TQ. I hope the Project Discovery team continues to evaluate the results and make adjustments so that spammers aren't benefiting from the accuracy gains while the rest of us scratch our heads. |

Zepheros Naeonis
TinklePee
74
|
Posted - 2016.03.11 13:22:11 -
[3] - Quote
HPA Darkfield Oramara wrote:I'm glad it helped! We will of course keep track of how well you are doing and also keep taking your inputs into account! This is however not an easy task we have been giving you, so I'm expecting the consensus to improve (even though it's way far from bad already, most classifications are fine) with time. It takes a while to learn what to look for and to get a feeling for all the different stainings. Trust me, I'm basing this on my own experience  Understandable. I am noticing a bigger improvement with just today's rounds compared to yesterday. Seems to be going a lot more smoothly for me and I can see this improving the community concensus results over the next few weeks as everyone gets the hang of it / better understands the choices. |

Zepheros Naeonis
TinklePee
75
|
Posted - 2016.03.12 05:22:45 -
[4] - Quote
Yadaryon Vondawn wrote:By request of the HPA guys over at twitter here is a recording of me playing Project Discovery. In the video I explain why I make the choices I make. I hope it gives you guys a frame of reference when doing Project Discovery. How to classify samples Great video. Nice to see some uncertainty on your part even compared to the community concensus as I run into this quite a bit myself, lol. |

Zepheros Naeonis
TinklePee
76
|
Posted - 2016.03.13 19:54:02 -
[5] - Quote
March rabbit wrote:Well... Need to say i'm feeling the game 'guess community decision' here instead of 'analyze the image and set categories'.... After about 20 images i'm starting to lose interest because i'm bad at social predictions and most of the time community chosen categories are not closer to image than the ones i have chosen. I found this to be mostly true as well, but seeing as PD was just launched it is going to take some time for this to balance out and the community gets better at correctly picking the selection.
I still select what I believe a sample to be, even if I know it is likely to be wrong according to "community concensus", because I know there is a small chance the community actually picked the right one. It really is a hit or miss.
I am level 30 right now with 72% accuracy, so it isn't completely flawed, just taking a little longer for players to... use some common sense while determining what image is what. |

Zepheros Naeonis
TinklePee
76
|
Posted - 2016.03.17 11:57:48 -
[6] - Quote
PD is definitely having issues right now. It took nearly 10 seconds for the GUI to load when I clicked on it. I've noticed these issues have been on going for 3+ days now. I have over 120 submissions that haven't been touched in over 24 hours. :\
HPA Darkfield Oramara wrote:Thanks for noticing! We are aware of the problem and we have notified CCP about it so hopefully it will be fixed soon. Any word on the current issues with PD? It has been extremely sluggish. |

Zepheros Naeonis
TinklePee
77
|
Posted - 2016.03.24 10:39:49 -
[7] - Quote
Steve Pirkibo wrote:I am unsure if this has been reported already but I am experiencing a bug with project discovery on this toon. Ever since I started project discovery on this toon (I have another toon that I started it on) I have not been able to see my submission history at all. Also, once I hit 80% or so, the only thing that would affect my accuracy rating was the guaranteed right/wrong samples. I am currently rank 42 with ~95% accuracy. They removed accuracy ratings from community consensus, so submission history serves no purpose at the moment. Accuracy is only affected by random pre-selected images to test whether you are actually selecting the correct result. |
| |
|